Digital photography 

CLICKS • 





BROw DiPEitT, Technical Editor 

Digital cameras contain several highly interdependent 
subsystems and rely on other hardware and software 
to complete the picture. Whejr^erything clicks, the 

ults are impressive. 



Digital imaging i^i. still in its infancy compared with tra- 
ditional silver-fialidt'-based pliotography. This new tech- 
jiology has both advocates and detractors in the elec- 
tronics and photography communities, but many 
companies have u strong interest in seeing digital 
imaging succeed. The circuits, mechanics, and 
^ftvirare within digital cameras are intriguing, 
trade-offs and partnerships that 
cturers make in image capture and 
PC-based image processing, transmission, 
f^anhiving, and output. These companies 
^^^Bst balance sevtral camera rcquirt- 
^^Kients, including: 

• base cost; 
W • cost of accessories, such as memory 
W cards, cables, and power adapters; 
I • image fesolutton; 

• sharpness; 

• color depth and density; 

• power consumption; 

7» ease of use with both the camera's user 
inteffate and any trundled S6ftware; 
• ergonomics; 
• stand-alone operation vs PC dependency; 
• upgradability; 
• compatibility with existing camera equip- 
ment; 

• performance, in both the delay from shutter press 
until the camera takes the picture and the delay 
between pictures; and 
the number of pictures that you can take before frll- 
ing the storajge media. 

In a Bew industry Id wtiicliiici stMidards exist and end 
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Don't just raise your expectations 

Double them. 

Intel's new StrataFlash " memory. 
2x the bits in Ix the space. 



I 



Storing two bits of infor- 
mation per transistor, 
instead of the usual one, 
was once mere fantasy. 
But leave it to Intel, the leader in flash 
technology, to find a way to do it. And 
oiak^ M easy and eewiomicat, too. 

One architecture for code or data 

What you thought would never happen 
h now possible with Intel's StrataFlash™ 
memory. Finally, you have all the density 
you need for large code or data storage 
in one architecture. With stand-alone, 
single chip solutions and the renowned 
reliability of your familiar NOR archi- 
tecture, Intel has made multi-level cell 
flash memory a reality. 

Unprecedented density and more 

Intel's Strata Flash memory is the only 
flish NOR architecture that provides 
up to 64Mbits of density in a single 
chip. And you get an upgrade path to 
12^Mi>its and beyond. It's avaiJM)le in 
istHotu densities and pacfeage options. 



including industry standard TSOP as 
well as SSOP. What's more, with its new 
MicroBOA' packaging, Intel StrataFMi 
memory gives you the highest density 
available in the smallest form factor 

Compadbittty ftHKifif p&rt 

With Common Flash Interface, an open 
flash specification supported by leading 
NOR manufac- h 



Leading- edge technology 
for cost' effective solutions. 



turcfs, you can 
count on future 1 
compatibility and 
crOss-vendor support. Plus, we can 
provide the tools you need in all stages 
of your system design, including free 
software and behavioral models. 

Realize the possibilities 

The time has come to change your expec- 
tations. Because now with StrataFlash 
memory from Intel, the possibilitks arc 
endless. For pricing, availability and 
product information, visit our Web site, 
orcaP l-80Q-S79-4683,ext.435. 
► d&veloper.lntel.Gom/desian/psarl* 
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Digital cameras for less than $500 (a), less than $1000 (b), and more than $1000 
(c) deliver unique features and, therefore, have quite different internal architec- 
tatu (iE^wti^ Ewtman Kodak). 



aistomer's real and perceived needs are 
unclear, decision making is especially 
difficult. Success requires fast product- 
development cycles, close coordina- 
tion within and among development 
teams (as wen as araon^ companies), 
and a commitment to take educated 
risks with little or no short-term payoff. 
Success also requires knowing when to 
stay with an idea in the face of initial 
skepticism along with a willingness to 
change course when a "better mouse- 
trap" clearly emerges. The core of engi- 
neering is this balancing act between 
what is theoretically possible And what 
is practically achievabie. 

Representative cameras from East- 
man Kodak illustrate products priced at 
less than $500, less than $1000, and 
more than llOOO (Hgure 1). KcxJak was 
one of the first companies to heavily 
invest in digital imaging and today has 
one of the broadest product lines. Cam- 
eras from other manufacturers in each 
prke ran^ ofttn have wmparabk Sea- 

Good pictures need good optics 

A digital camera is only as good as its 
weakest itnfe, and the image-capture 
process begins with the lens. The fun- 
damental trade-off that engineers make 
is between plastic and glass lenses. Plas- 
tic lenses are less expensive, aad under 
controlled condWkmf they tttn deliver 
surprisingly better results than glass 
alternatives. However, plastic is far 
more sensitive to temperature varia- 
tions, scratches more easily, and is 
mofe suscepTibJe to light-caused flare 
«ffects than glass. 

Kodak's DVC300 is a USB-tethered 
camera for teleconferencing and low- 
resolution stilJ-image capture. It was 
designed for office use with adequate 
diffused lighting, stable temperatures, 
and minimal handling, so Kodak chose 
plastic lenses. The DC120 and DC210 
target users of portable 35-mm cameras 
and need to handle rougher treatment 
and wide variations in temperature and 
lighting. Thus, they use higher quality, 
coated-glass lenses. At the high end, 
the DCS460 takes advantage of the 
atmnment of Nikon optics. (Digital 
isnieras itSing Ctoon (Toiyo) .MiA 



Minolta (Tokyo) 35-mm singie-lens- 
reflex equipment are also available.) 
ffowever, because the CCD sensor is 
smaller than the dimensions of a 35- 
mm frame, the effective focal length of 
a given lens increases. To a point, lens 
quality improves with a larger number 
of lens elements. Similar to (xP caching, 
however, greater complexity eventual- 
ly nets diminishing returns. 

What about focus? Lemts exhibit a 
ph«ftDm«a5n railed tt^e "hypeifocal 



distance," a function Of the lens-ele- 
ment placement, aperture size, and 
lens focal length that defines the in- 
focus range. All objects from half the 
hyperfocal distance to infinity are in- 
focus. The DVC300 lens in Its default 
setting is designed for installation 
above the PC monitor with the PC user 
a few feet away. Using the PC iwcmitoE 
as feedback, the DVC300 also has a 
manual-focus mcxiit for sdll-itflafe 
ctot«-yp£. Tills capabEifj' U wsM^ 



EDN December 18, 1997 ' 51 



esample, 'dyuu wmit to show a ptcture 
of some equipmEnt you have in front 
of you to the person with whom you 
are teleconferencing. 

The DC210, because of its point-and- 
shoot target market, has a fixed-focus 
lens. Interestingly, the DC120, a cam- 
era of roughly the same price but tar- 
geting the more serious photographer, 
has an autofocus lens with a macro 
mode. Autofocus adds cost in ftie fonn 
of lens-element movement motors, 
infrared focus sensors, control-proces- 
sor complexity, and other circuits, but 
the DC210 spends its feature-set bud- 
get In other areas. Minolta's Dimage V 
has a unique lens design: The optics 
and sensor connect to the remainder of 
the camera using a 3-ft cable and can 
detach to capture otherwise-inaccessi- 
ble shots or fo achieve unique camera 
angles. 

The DVC300 and DC120/DC210 
offer a digital zoom and an optical zoom, 
respectively. A digital zoom doesn't 
alter the orientation of the lens ele- 
ments. Depending on the digital-zoom 
setting, the camera discards a portion 
of tliff pixel information that the image 
censor captures. The camera then 
enlarges the remainder to fill the 
expected image-file size. In some cases, 
the camera replicates the same pixel 
ixiFormatjon to multiple output-file 
bytes, which can cause jagged image 
edges. In other cases, the camera cre- 
ates intermediate pixel information 
using nearest-neighbor approximation 
or more ccrmplex gimdleat-«toiiififcQcai 




a glance 



Initially, only specialized applications used digital cameras, but higher output 
quality and lower prices are broadening their appeal. 
Optics trade-offs reflect cost and application targets. 

Required image resolution and color quality depend on how you plan to dis- 
play your pictures and on picture size. 

Image processing goes beyond a strictly accurate rendering of the scene to 
adjust for user preferences. 

Numerous memory types and densities and a variety of output methods pro- 
vide additional opportunities for digital-camera manufacturers to differentiate 
themselves. 



techniques; this process is CBHed "inter- 
polation" (Figure 2). Interpolation's 
chief disadvantage is that it blurs edges 
compared with those of the same 
image^ captured using a higher resolu- 
tion sensor. 

With optical zooms, the chief trade- 
off is between manual and motor- 
assisted zoom control. The latter incurs 
additional cost, but camera usfefS often 
prefer it for its easier operation. The 
DC120 and DC210 lenses have a 
threaded front ring that enables the use 
of filters, wide/telephoto OonvErteiS, 
and other accessories. 

Behind the lens and in front of the 
image sensor, many cameras employ 
an optical prefilter — a piece of quartz 
that selectively blurs th€ image. This 
prefilter conceptually serves the same 
purpose as a lowpass audio filter. 
Because the image sensor contains 
fixed spacing between pixels, light 
wavelengths, shortfi tbtm twice this 



distance can produce aliasing distor- 
tion if they strike the sensor. (Notice 
the similarity to the Nyquist audio- 
sampling frequency?) A similar type of 
distortion comes from taking a picture 
containing edge transitions that are too 
close together for the sensor to accu- 
rately resolve them. This distortion 
often manifests itself as color fringes 
around an edge (Figure 3) or as a series 
of color ring.s known as a moire pat- 
tern. The DCS460, because it uses the 
optical subsystem of a standard 35-mm 
camera, has no prefilter, but its higher 
quality lens and image sensor iniier* 
ently minimize aliasing effects. 

Almost all digital cameras contain a 
viewfinder that aids in framing the pic- 
ture. If the camera provides zoom, the 
viewfinder angle of view and magnifi- 
cation often adjust accordingly. Many 
cameras use a range-finder configura- 
tion, in which the viewfinder has a dif- 

kmVi m of opUa (ar^, tbErefope, i 
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slightly different viewpoint) from ttiat 
of th? lens used to capture the image. 
Viewtrnder marlcs that delineate the 
lens-view borders partially correct this 
difference, or "parallax error." At 
ftxtteme close-ups, the LCD gives the 
mo*t accurate framing representation 
of your picture. Olympus' (Tokyo) D- 
500L and D-600L digital cameras share 
&st same single-lens-retlex architecture 
as the company's 35-inm and Ad- 
vanced I*hoto System cameras. Because 
you coinpose the picture through the 
same lens that takes it, there is no par- 
dMx «t04 but m±. a OimeMi requires 
a mirror, a shutter, and other mechan- 
ics to redirect the light to the viewfind- 
er prism. If the camera is a digitized ver- 
sion of a standard 35-mm or 2'/4-in. 
sing]e-lens refkx, iuch as the Kodak 
DCS43^, these mediainiCs aFfSdy exist. 

Editing needs sensing first 

Many camera manufacturers, when 
twlktug about digital "film," are refer- 
ring to the flash memory or other 
image-storage media. These companies 
are only half right. The other film func- 
tion — capture — occurs in the sensing 
subsystem, whidi contprises the CCD 
or CMOS sensor, analog processing cir- 
cuits, and ADC. Almost all of today's 
digital cameras use CCDs. Toshiba 
(Tokyo), Umax (Fremont, CA), and Viv- 
itar flbJcyo) all ssTl di^al camer»s with 
CMOS sensors (Sound Vision designs 
and builds the last two cameras), and 
you can expect mere in the aear fWure 
(Reference 1). 

The ATX! prtmarily deterTrtines a 
Camera's color depth or precision 
(number of bits per pixel), although 
b»ck-en<l processing can ajtificiaily 




Frequency information above tlie sensor's upper resolution limit can cause color 



increase this precision. A camera's color 
density, or dynamic range, which is its 
ability to capture image detail in light 
ranging from dark shadows to bright 
highlights, is also a function of the sen- 
sor sensitivity. Sensitivity and color 
d^pth improve with lairget eaU size; the 



bigger the cell, the more electrons 
available to react to light photons and 
the wider the range of light values the 
sensor can resolv«. C^U size must baV 
ance with the desired number of cells 
(resolution) and the percentage of the 
CCD devoted to cdls t$ athor etaalts 



Memory, output, sample photos, and the rest of the picture 



Digital cameras contain several memory types in varying den- 
sities to match usage requirements and cost targets. Cameras 
also offer a variety of options for displaying the images and 
transferring them to a PC, printer, VCR, or television. 

Flatbed and slide/negative scanners are other options for 
digitizing an image, as are digital camcorders. Some film 
developers even digitize your photos for you and send you a 
diskette along with negatives and prints or put them on a Web 
site for you to download. 

Onceyour pictures are in digital file forrn, you can choose 



from dozens of editing-software packages for PC-based image 
manipulation, each with differing prices and features. Pictures 
can quickly fill your hard drive, so you need to think about 
cost-effective archiving. Eventually, you want to print your cre- 
ations, and numerous alternatives exist for this purpose as well. 

See EON'S Web site, www.ednmag.com, for more on digi- 
tal photography. The Web site includes example Images taken 
with less-than-$500, less-than-$1000, and more-than-$1000 
digital cameras and with Kodak's Picture Network. Thus, you 
can see hoyv_the trade -offs in each ^^^^ ^^^j^^^m^^ 



EDN DECEMBER 18, 1997 ' S3 



Figure 4 



(area efficiency, or fill fac- 
tor). As with TVs, PC moni- 
tors, and DRAMs, sensor 
cost exponentially increas- 
es as sensor area increases 
because of lower yield and 
other technical and eco- 
nomic factors, 

A digital camera uses one 
of three kinds of CCDs (Fig- 
are 4). Linear sensors, 
which you can also find in 
digital copiers, scanners, 
and fax machines, offer the 
best combination of low 
cost and high resolution, 
but cameras using them 
sequentially sense and 
transfer each pSxef row of 
the image to an on-chip 
buffer. For this reason, lin- 
ear-sensor-based cameras 
have long exposure times 
and are usable only with 
still-life subjects. Full- 
frame-area sensors, such as 
those in Kodak's DCS460, have high 
area efficiency and simultaneously cap- 
ture an of the image pixels. However, 
full-frame-area sensors require a sepa- 
rate mechanical shutter to block light 
when you're not taking a picture and at 
the conclusion of an exposure, when 
ttif nrmerU tfansfm each cell's stotcd 
charge to the ADC. 

The third and most common CCD 
type is the interline-area sensor. Also 
used in camcorders, the interline-area 
serrsor cbnralnsboth charge-accumula- 
tion and corresponding light-blocked, 
charge-storage elements for each cell. 
Sepurate charge-storage elements 
remove the need for a costly mechani- 
cal shutter and also enable slow-frame- 
rate video display on the camera's LCD. 
However, the area efficiency is low, 
Causing a decrease in sensitivity, reso- 
lution, or both for a given sensor size. 
Also, a portion of the light striking the 
sensor doesn't actually enter a cell 
unless the CCD contains microlenses 
(Figure 4c). 

Regardless of the type, still-image 
sensors have far more stringent require- 
ments than their video alternatives. 
Video includes motion, which draws 
your attention a-way from low Image 




INCOMING LIGHT 
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CCD 



Linear (a), full-frame-area (b) and interline-area (c) 
each have strengths and shortcomings when used in 
eri» (coarte^ iastman Kocfedi}. 



limited dynamic range, and other 
shortcomings. With still images, these 
errors are immediately apparent. Video 
scanning, similar to television display, 
is interlaced, but still-image scanning is 
ideally progressive. Interlaced scan- 
ning with still-image photography can 
result in pixel rows with image infor- 
mation shifted relative to each other. 
This shifting is due to subject motion, 
a phenomenon more noticeable in stil! 
images than in video. 

Cell dimensions are another funda- 
mental difference between still and 
video applications. Camcorder sensor 
cells are rectangular, often with 2-to-l 
horizontal-to-vertical ratios, corre- 
sponding to television- and movie- 
screen dimensions. Still pictures look 
best with square pixels, analogous to 
film "grain." Ironicalty, Kodak's DC20, 
DC25, and DC 120 cameras, as well as 
Polaroid's PDC-2000, use rectangular 
cell sensors that benefit from the high- 
volume cost savings of the videocam- 
era market. As part of the DC120 post- 
sensing image-processing step, Kodak 
converts each two rectangular cells' 
information into approximately three 
square image pixels. This type of inter- 
polation sidfers greater loss of resolu- 
toi in am hmSBsnml dirtdaop: than in 



sensor types 
digital cam- 



the vertical but other- 
wise produces good 
results. 

Although low-imd 
cameras may not pro- 
duce 35-mm-compatible 
images if you blow up 
the photographs to 5x7 
in. or larger, camera 
manufacturers carefully 
consider their target cus- 
tomers' usage when 
making feature deci- 
itons. PCs (including 
Macs and workstations) 
have monitor resolu- 
tions on the order of 72 
lines/in., and many 
Web-she-published snd 
e-mailed photos take up 
only a percentage of the 
display and use a limited 
color palette. Color ink- 
jet printers, even if they 
advertise 600, 720, or 
14,400 dpi, require 
image resolutions roughly one-third 
(or less) that stringent. Depending on 
the prtnter's tnR-control capability, it 
may use multiple groupings of cyan, 
magenta, yellow, and black (CMYK) 
dots to represent a broader color range 
for each image pixeL This process is 
called "Tiatf-tDn!ng*; some printers use 
as many as seven ink colors for addi- 
tional color accuracy. The image reso- 
lution needs to match the declared 
printer resolution only when the out- 
put is black and white or When you use 
a dye sublimation or other, higher 
quality color printer. Finally, consider 
that more than 90% of all of today's 
traditionally developed photos are 
4x6-in. or smaller. However, if you 
might enlarge an image or a portion of 
that image, you want to invest in one 
of the million-pixel or higher resolu- 
tion cameras. 

The DVC300, targeting VGA moni- 
tors, has a 640X480 (307,200)-cell sen- 
sor, and most of the new cameras for 
the less-than-$500 mass consumer 
market specify similar resolutions. 
640x480-pixel resolution also pro- 
duces good-quality, snapshot-sized ink- 
jet prints. The DC120 contains a 
SS0x984-celt sensor (836,400 reclfln- 
g«lti cell*), which int'efptJlates to 
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Building on an analog foundation 



The earliest electronic cameras appeared in the early 1 980s, beginning with Sony's 
(Tokyo) Mavica, under the name Still Video Floppy (SVF). SVF cameras were not 
yet digital but adapted interlaced scanning sensors and analog recording technol- 
ogy used in the video equipment of the day (NTSC or PAL). Users could display 
images, which were stored on 2-in. floppy disks, directly on a TV but needed a 
video-capture board to input the images to PCs. The 350- or 500-line resolution 
(called "Hi-Baud," which is conceptually similar to Super VHS) was acceptable for 
television but produced poor print results, even at small print sizes. Color depth 
and accuracy, though satisfactory for fast-moving video, were also noticeably inad- 
equate for still-image viewing, and noise and instability produced unpredictable 
results. Ironically, among today's Sony digital cameras are two models, called Dig- 
ital Mavicas, sharing a common name with their analog ancestors and a similar 
storage medium — the floppy disk (now a 3.5-in. version). 



Digital, Cameras 

1280x960 {l,228,800)-square-pixel 
counterparts. Kodak's DC210 uses a 
square-cell sensor measuring 1160x 
872 (1,011,520) cells. Polaroid's PDC- 
2000 includes a 1656x620 (1,026,720)- 
rectangular-cell sensor, which back- 
end processing converts to a 800x600 
(480,000, SVGA)- or 1600x1200 
(l,920,000)-square-pixel image. Ko- 
dak's DCS460 contains a 3072x2048 
(6,291, 456)-squarE-cell CCD sensor. 
The resultant 24-bit color file is almost 
20 Mbytes! 

A sensor, normally a monochrome 
device, cannot extract specific color 
information if it is exposed to a full- 
color spectrum, so the sensor requires 
some prefiltering. The three most com- 
mon methods of controlling the light 
frequencies reaching individual pixels 
are to use multiple sensors, a rotating 
multicolor filter, or a color-filter array 
(Figure 5). In each case, the most pop- 
ular filter palette is the red, green, blue 
(RGB) additive set, which color displays 
also use. The RGB additive set is so 
named because these three colors are 
added to an all-black base to form all 
possible colors, including, ultimately, 
white. 

The subtractive color set of cyan- 
magenta-yellow is another filtering 
option (starting with a white base, such 
as paper, subtractive colors combine to 
form black). The biggest advantage of 
subtractive filtration is that each filter 
color filters through a portion of two 
additive colors (yellow filters allow 
both green and red light to pass 
through them, for example), for this 
reason, cyan-magenta-yellow filters 
give better low-light sensitivity, an 
ideal characteristic for camcorders. 
However, the filtered results fnust sub- 
sequently convert to RGB for display. 
Lost color information and various arti- 
facts introduced during conversion can 
produce nonideal still-image results. 
StiJl cameras, unlil<e camcorders, can 
also easily supplement available light 
with a flash. 

The muhisensor color approach, 
with three separate filters and sensors, 
produces accurate results but is also 
costly (Figure 5a). A color-sequential- 
rotating filter (Figure 5b) requires three 
separate exposures and, therefore, suits 
only $dlJ-llfe photography. A variation 



of this second technique that uses a tri- 
color LCD, the liquid-Crystal tunabk 
filter, promises much shorter exposure 
times, but only very expensive cameras 
offer this filter. The third and most 
common approach, an integral color- 
filter array, places an individual red, 
green, or blue (or cyan, magenta, or yel- 
low) filter above each sensor pixel, rely- 
ing on back-end image processing to 
approximate the remainder of each 
pixel's light-spectrum information 
from nearest neiglitaors. 

Note that in Figure 5c, there are 
twice as many green pixels as there are 
red or blue. This structure, called a 
Bayer pattern after Kodak scientist 
Bryce Bayer, results from the observa- 
tion that the human eye is more sensi- 
tive to green than to red or blue, so 
accuracy is most important in the 
green portion of the ojlor spectrum. 
Variations of the Bayer pattern are 
common but not universal. Polaroid's 
PDC-2000 uses alternating red-, blue- 
and green-filtered pixel columns, and 
the filters are pastel or muted in color, 
thereby passing at least a small per- 
centage of multiple primary-color 
details for each pixel. Sound Vision's 
CMOS-sensor-based cameras use red, 
green, blue, and teal (a blue-green mix) 
filters. 

High-end digital cameras offer vari- 
able sensitivity, akin to an adjusUhit 
ISO rating for traditional film. In some 
cases, summing multiple sensor pixels' 
worth of information to create one 
image pixel accomplishes this adjust- 
ment; however, other camoxas use ani 



analog amplifier to boost the signal 
strength between the sensor and ADC, 
which can distort and add noise. In 
either case, the result is the appearance 
of increased grain at high-sensitivity 
settings, similar to that of high-ISO sil- 
ver-halide film. 

Although most PC software and 
graphics cards do not support pixel 
color values larger than 24 bits (8 bits 
per primary color), why do you often 
And lO-bit, l2-bit, and even larger 
ADCs in digital cameras? The human 
eye notices quantization errors in the 
shadows, or dark areas, of a photograph 
more than in the highlight, or light, 
sections. GreatBr-than-8-bit ALX^ preci' 
sion allows the back-end image proces- 
sor to selectively retain tlie most impor- 
tant 8 bits of image information for 
transfer to the PC. According to 
Kodak's Ken P&rulski, chief architect for 
digital cameras, less-than-8-bit ADCs 
make little sense; these converters 
would provide little system-cost sav- 
ings, and the color quality would be 
acceptable only on a 256-color display. 

Image processing: black magic 

Digital cameras' hardware designs 
are rather straightforward and in many 
cases benefit from experience gained 
with today's traditional film cameras 
and video equipment. Image process- 
ing, on the other hand, is the most 
important feature of a camera (your eye 
and brain can quickly discern between 
"good" and "bad" prints). It is also the 
area in which camera manufacturers 
hav€ the greatest opportunity to dlfet- 
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entiate themselves and in which 
they have the least overall con- 
trol. Image quality depends high- 
ly on lighting and other subject 
characteristics. Not only software 
and hardware inside the PC (if it 
exists) can degrade the camera 
output, but also the printer or 
Other Output equipment. Because 
capture and display devices have 
different color-spectrum-re- 
sponse characteristics, they ideal- 
ly should calibrate to a common 
reference point, so that they auto- 
matically adjust a digital image 
passed to them by other hardware 
and software to produce opti- 
mum results. Thus, several Indus- 
try standards and working groups 
have sprung up, the latest being 
the Digital Imaging Group (Www. 
digitalimaging.org). 

The Wggest ttade-off in tht 
image-and-control-processor sub- 
system is the percentage of image 
processing that takes place in the 
camera vs in a PC. Until the 
DC210, Kociak's digital cameras 
completed most, if not all, image 
processing in the PC after trans- 
ferring the image files out of the 
can>era. For the DVC300, process- 
ing is completely PC-based; the 
camera contains little more than 
a sensor, an ADC, an Altera (San 
Jose, CA) CPLD for simple state- 
machine control, and an Intel 
USB peripheral controner. OfhW 
Kodak cameras optionally com- 
press the CCD output and per- 
form simple processing to con- 
struct a low-resolution and min- 
imum-color tagged-image-fomiat-file 
(TIFF) image "thumbnail," used by the 
LCD (if the camera has one) and by the 
PC's image-editing software. This 
^proach has several advantages: The 
camera's processor can be low-perform- 
ance and low-cost, and minimal 
between-picture processing means you 
can take the next picture faster. The 
files are smaller than their fully fin- 
ished lossless alternatives, such as TIFF, 
so you can take more pictures before 
"reloading." Also, you lose no image 
detail or co!or quality imide the eam- 
ew because of the conversion to an 
ftQfi of other color gamut or to a lossy 
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control the portion of the color spectrum that pass- 
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file format, such as JPEG. Intel, with its 
Portable PC Camera '98 Design Guide- 
lines (www.intel.com/imaging), strong- 
ly recommends a PC-based-processing 
approach. Intel's 971 PC Camera, 
including an Intel-developed 768x 
576-cell CMOS sensor, also relies on the 
PC for most image-processing tasks. 

The alternative approach to image 
processing is to complete all operations 
within the camera, which then outputs 
pictures in one of several finished for- 
mats, such as JPEG, TIFF, and FlashPix. 
Notice that many digital-camera man- 
ufacturers also make photo-quality 
printers. Although these companies are 



not precluding a PC as an inter- 
mediate image-editing and 
-archiving device, they also want 
to target the roughly 50% of 
households that don't currently 
own PCs by providing a means of 
directly connecting the camera to 
a printer. If the camera outputs a 
partially finished and proprietary 
file format, it puts art added bur- 
den on the camera manufacturer 
or application developer to create 
PC-based software to complete 
the process and to support multi- 
ple PC operating systems. Finally, 
nonstandard film formats limit 
the camera user's ability to share 
images with others (e-mailing 
your kids' pictures to relatives, for 
example), unless they also have 
the proprietary software on tiieiT 
PCs. 

Regardless of where thf Image 
processing occurs, it contains sev- 
eral steps, according to Kodak's 
Parulski. First, if the sensor uses a 
Bayer or other selective color-fil- 
tefing technique, interpolation 
reconstructs 8 or more bits each of 
red, blue, and green information 
for each pixel. Second, processing 
modifies the color values to adjust 
for differences in how the sensor 
responds to light compared with 
how the eye responds (and what 
the brain expects). This conver- 
sion is analogous to modifying a 
microphone's output to match the 
sensitivity of the human ear and 
to a speaker's frequency-response 
pattern. Color modification <an 
also adjust to variable-lightiag 
conditions; daylight, incandescent Illu- 
mination, and fluorescent illumination 
all have different spectral frequency 
patterns, for example. 

Processing can also increase the sat- 
uration, or intensity, of portions of the 
color spectrum, modifying the strictly 
accurate reproduction of a scene to 
match what humans like to see. Cam- 
era manufacturers call this approach 
the "psychophysics model." It's an 
inexact science, because color prefer- 
ences highly depend on the user's cul- 
tural background and geographic loca- 
tion (people who live in forests like to 
see more green, and those who live in 
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deserts prefer more yellows and 
btowns). The characteristics of the pho- 
tographed scene also complicate this 
adjustment; adding red to the image 
mlfht produce a more pleasing 
auteimn-leaf picture w^ljt 0.y^ 
%k\Ti tones an undtsiraWe futftufht 
look. For this reason, some cameras, 
when you press the shutter once, actu- 
ally capture multiple images at diff^- 
ent exposure and cojor settings, sam- 
pling each and selecting the one they 
"think" you'll prefer. After turning on 
the DVC300, you won't see the first few 
feaases, iserause during that time the 
camera and PC communicate with 
each other over USB, calibrating for the 
best possible results. 

After color adjustment, processing 
can ilsG sharpen the image. SimpJistl- 
cally, the sharpening algorithm com- 
pares and increases the color differ- 
ences between adjacent pixels. How- 
ever, to minimize jagged output and 
other fioist artifacts, this irtcrease fac- 
tor varies and occurs only beyond a 
specific differential threshold, imply- 
ing an edge in the original image. Com- 
pared with standard 35-mm cameras, 
you may find It afflailt to areate shal- 
low dejih of field Mtti diglta! oaxneias; 



this characteristic is a function of both 
the optics differences and the back-end 
sharpening. In many situations, 
though, focusing improvements are 
valuable features that increase the 
nunjber of usable pictures. The ^na] 
proteasing steps are image-d^Ta com- 
pression and file formatting. The com- 
pression is either lossless, such as the 
Lempel-Zif- Welsh compression in TrFF, 
or lossy QVEG or variants). The com- 
pressed-file size depends on the 
amount of pixel data variability in the 
original image. If the camera offers a 
fixed file size for each camera setting, it 
probably varies the compression ratio 
on a per-image basis to maximiie qual- 
ity and minimize the delxf wtetJe<i 
between successive shots. 

Image processing can also partially 
correct nonlinearities and other defects 
in the lens and sensor; this approach is 
how NASA obtained usable images 
from the Hubble space telescope until 
Its optics system was upgraded. Some 
cameras also take a second exposure 
after closing the shutter, then subtract 
it from the original image to remove 
sensor noise, such as dark-current 
effects seen at long exposort rimes. 

Processing power fuiidamerttally 



derives from the desired image resolu- 
tion, the color depth, and the maxi- 
mum-tolerated delay between succes- 
sive shots. For example, Polaroid's 
PDC-2000 processes all images inter- 
naUy Jri_the j^jaeia's high-resolution 
rndd^bStettfe'cfin the host PC for its 
superhigh-resolution mode. Many pro- 
cessing steps, such as interpolation and 
sharpening, involve not only each tar» 
get pixel's characteristics but also a 
weighted average of a group of sur- 
rounding pixels (a 5x5 matrix, for 
example). This involvement contrasts 
with pixeWsy-pixel operations, Iticti m 
bulft-image color shifts. Imagc-cotn- 
pression techniques also make fre- 
quent use of discrete cosine transforms 
(DCTs) and other multiply-accumulate 
convolution operations. For th«« rea- 
sons, fast on-processor hardware-mul- 
tiply circuits are desirable, as are many 
on-CPU registers to hold multiple 
matrix-multiplication coefficient sets. 

If the image processor has spare 
bandwidth and many I/O pins, it can 
also serve double duty as the control 
processor — running the autofocus and 
zoom motors and flash, responding to 
user inputs, and driving tite LCD an-d 
InterfaafcuSes. AE^undiEitl/O ptiisMso 
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DCAM-Tdl con^iB^ a MIPS HWttO core wdh oth«r tmafiiig^optlmtzed peripheric functions on »m ciWp (isw^^ L9 logic). 
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enable selective shutdown of camera 
subsystems when ^ef St<t nci m use — 
an important attribute in extending 
battery life (along with frugal use of the 
LCD). The DVC300 draws all power 
solely from the USB connector, making 
tow ^vrnt cofisumptton especlaily 
critical. 

Sierra Imaging has just announced 
its Raptor coprocessor for Fujitsu's 
SPARClite embedded processor, offer- 
Mg fast on-chfp hafdwaire multiply and 
interface flexibility to many front-end 
CCD and CMOS sensors and back-end 
displays and transfer buses. Following 
the math coprocessor model, you can 
easily Imagine imaging coprocessors 
and CPU cores integrated on a com- 
mon ASIC within a short time. Sierra 
provides several digital-photography 
products: coprocessors, full camera ref- 
erence designs, and host-based editing 
software. Whereas the company's first 
reference design based on SPARClite 
executed roughly 100,000 instruc- 
tions/image in approximately 8 sec, the 
coprocessor, along with CPU-perform- 
ance improvements, will enable com- 
pletion of more than 500,000 instruc- 
tions/image in less than 1 sec. 

Kodak's DC120 uses the Hitachi 
SH7034 for both control and simple 
image-processing functions, plus a sep- 
arate ASIC for DCT-based compression. 



The DC210, on the other hand, out- 
puts JPEG and FlashPix finished files; 
therefore, its processing requirements 
are more rigorous. The DC210 uses 
Hitachi's new SH-DSP processor, a sin- 
gle-chip combination of the 32-bit SH- 
2 and a 16-bit imaging-optiroized DSP. 
Kodak's DCS460 includes an Intel 
80C196 for control and voice annota- 
tion of the image files, plus two Xilinx 
(San Jose, CA) FPGAs for fast, reconfig- 
urabte, hardwa-re-based image process- 
ing, enabling multiple-shot bursts. 
Kodak plans to use Motorola's 
(Schaumburg, IL) MPC800 embedded 
PowerPC processors for cameras in 
dcwfopment, part of the two compa- 
nies' recently announced joint tech- 
nology agreement that also includes 
CMOS-sensor development. Atmel 
(San Jose, CA) and Polaroid also have a 
tolrtt awltJpmentreimfott'sfitlp, rt*tfi a 
similar future vision of the single-chip 
(sensor and processor) digital camera. 
Finally, LSI Logic just announced its 
DCAM-101 image processor, based on a 
MiPS (Mountain View, CA) R3000 core 
(Figure 6). 

1. Kempainen, Stephen, "CMOS image 
sensors: eclipsing CCDs in visual infor 
mation?" EDN, Oct 9, 1997, pg 101. 
2. Digital Camera Companion (ISBN 



1-57610-097-9), Coriolis Group Books, 
Scottsdale, AZ, 1997. 

3. Internet news groups: alt. 
comp.perlphs. scanners, comp. 
graphics. apps.photoshop, comp. 
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